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© Slmd array processor. 

© A single-instruction-multiple data SIMD array 
processor (10) comprising a multi-dimensionai array 
(12) of processing elements P(i,j) and control logic 
(14) for issuing global instructions to said array, is 
provided with processing elements which comprise a 
programmable decoding means for individually de- 
coding a global instruction, the programmable de- 
coding means of respective processing elements 
being programmable in response to a global load 
instruction from the control logic. 

In a particular example of a SIMD array proces- 
sor as described, the programmable decoder com- 
prises programmable look-up table for locally modi- 
fying selected bits of a global instruction, to form 
2 locally modified bits and fixed decoding logic for 
^decoding the bits of the global instruction as re- 
ceived and the locally modified bits. In this proces- 
sor, information defining the local modifications is 
™ loaded into the look-up table from storage in re- 
sponse to global load instruction. In the described 
IT example, the programmable decoding means are 
adapted to locally modify global information transfer 
° instructions, such that data may be transferred in a 
Q. plurality of directions at one time within the array of 
LU processors. 

A SIMD array processor in accordance with the 
present invention is particularly suitable for image 



processing applications and accordingly may be im- 
plemented as part of a display system. 
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© A single-instruction-multiple data SIMD array processor comprising a multi-dimensional array of processing 
elements P(i,j) and control logic for issuing global instructions to said array, is provided with processing 
elements which comprise a programmable decoding means for Individually decoding a global instruction, the 
programmable decoding means of respective processing elements being programmable in response to a global 
load instruction from the control logic. 

In a particular example of a SIMD array processor as described, the programmable decoder comprises 
programmable look-up table for locally modifying selected bits of a global instruction, to form locally modified 
bits and fixed decoding logic for decoding the bits of the global instruction as received and the locally modified 
bits. In this processor, information defining the local modifications is loaded into the look-up table from storage in 
response to global load instruction. In the described example, the programmable decoding means are adapted 
to locally modify global information transfer instructions, such that data may be transferred in a plurality of 
directions at one time within the array of processors. 

A SIMD array processor in accordance with the present invention is particularly suitable for image 
^processing applications and accordingly may be implemented as part of a display system. 
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SIMD ARRAY PROCESSOR 

The present invention relates to a single-instruction-multiple-data (SIMD) array processor comprising a 
multidimensional array of interconnected processors. 

There are essentially two types of array processors - MIMD (multiple-instruction-multiple-data) and 
SIMD (single-instruction- multiple-data). In a MIMD array processor each of the processing elements in the 
array executes its own unique instruction stream with its own data. This contrasts with an array processor of 
the type to which the present invention is directed, that is a SIMD array processor, in that the individual 
processing elements operate instead under the control of a common, or global instruction stream from a 
single control unit As the individual processing elements operate under the control of the common 
instruction stream, this means that a SIMD machine is less flexible and can execute a more limited range of 
functions in parallel than a MIMD machine. However, the parallel processing elements of a SIMD machine 
are typically simpler and more numerous than in a MIMD processor. 

Many SIMD array processors consist of a two dimensional array of processing elements, each 
processing element being connected to its nearest neighbours to form a so-called NEWS (North, East, 
West. South) network. Examples of array processors of this type are the ICL Distributed Array Processor 
(DAP), and the "Connection Machine" which are described in "Parallel Computers" by Hockney & 
Jesshope, Adam Hilger Ltd. 1981, pp 182-184 and "The Connection Machine" by W. Daniel Hillls, MIT 
Press 1986, pp 74-76 respectively. UK -A- 1445714 Is also illustrative of a prior art SIMD array processor. 

An example of the lack of flexibility of a SIMD machine arranged as a NEWS network can be seen with 
regard to a shift instruction. In a conventional NEWS networks all processing elements will receive data 
from their neighbour 1 place away in a given direction e.g. South. The direction of shift for each processing 
element in a conventional NEWS network Is globally and uniformly determined as a parameter of the global 
machine Instruction being executed with the result that all processing elements shift data in the same 
direction. A typical instruction would be to shift the data 3 places North. Some machines are able to 
selectively enable the processing elements in the NEWS network using a mask function so that the 
processing elements which have been enabled receive the global instructions. Also, in European Patent 
Application EP-A-208 457, a processor array is described on which each processing element in the array is 
able to select the element from which it takes its input 

The object of the present invention is to provide a SIMD array processor comprising a multi- 
dimensional array of processing elements which has an enhanced degree of flexibility to enable the 
potential for parallel processing to be better exploited without resorting to the expense and complexity of a 
MIMD processor. 

In accordance with the present invention there is provided a SIMD array processor comprising a multi- 
dimensional array of processing elements and control logic for issuing global instructions to said array, 
characterised in that a processing element includes programmable decoding means for the individual 
decoding for execution by that processing element of a global instruction, the programmable decoding 
means of respective processing elements being programmable in response to a global load instruction from 
the control logic. 

tn a particular embodiment of a SIMD array processor in accordance with the invention, which 
embodiment is to be described hereinafter, the programmable decoding means comprises programmable 
modifying means for locally modifying selected bits of the global instruction to form locally modified bits 
and fixed decoding means for decoding bits of the global instruction as received and said locally modified 
bits. 

In that particular embodiment, the processing elements in the array are each associated with storage for 
control information and data and, in response to a global load instruction, the fixed decoding means in a 
processing element causes modification information to be loaded from selected locations in said storage 
into the programmable modifying means of that processing element, whereby the programmable modifying 
means of respective processing elements may be programmed. Moreover, the processing elements in that 
embodiment are each associated with a corresponding block of said storage for control information and data 
and means are provided for the control logic to access said storage for storing appropriate modification 
information for the programmable decoding means in corresponding locations in each said block of storage. 

In the particular embodiment to be described hereinafter the programmable modifying means com- 
prises a look-up table having a serial write port for receiving said modification information serially from 
storage and a parallel read port for receiving said selected bits of a global instruction in parallel. 

Also, in the particular SIMD array processor to be described hereinafter the programmable decoding 
means are adapted to be programmed to locally modify a global shift instruction, whereby data distributed 
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Each processing element has access to a bit slice of main memory. Logically therefore, the main 
memory of the array processor is separated into 1024 slices for a 1024 processing element array. This 
means that up to thirty two 32-bit words can be transferred in or out of storage at one time. To perform a 
read or write operation, the memory is addressed in terms of an index address which is supplied to the 
memory address lines via an address bus 24 and a read or write instruction is supplied to each of the 
processing elements in parallel. During a read operation, the row and column select signals on the row and 
column select lines identify which of the processing elements are to perform the operation. Thus it Is 
possible, for example to read a single 32 bit word from memory into the 32 processing elements in a 
selected row. 

A host processor 28 is also shown In Figure 1. This processor is used to load microcode programs into 
the array controller 14, to exchange data with it and to monitor its status via a host-controller data bus 30 
and an address and control bus 31. The host processor can be any suitable general purpose computer 
such as a mainframe computer or a personal computer. No further description of the host processor is 
necessary as this does not form part of the present invention. 

The structure as described above is typical for prior art SIMD array processors. A processor of this type 
is described in UK-A-1 445 714. 

In the following, a specific embodiment of a SIMD array processor in accordance with the present 
invention, which also has the overall structure shown in Figure 1, will be described. It will be apparent from 
the following, however, that the present invention is not limited to the structure illustrated in Figure 1. For 
example, the array of processors could be organised on a 3-D, 4-D (using clusters), etc basis rather than on 
a 2-D basis. Also, instead of being configured as an item separate from a host processor, a SIMD array 
processor in accordance with the present invention may form an integral part of, for example, a display 
system such as a workstation with a display adapter. As will be clear from examples of algorithms which are 
described hereinafter, a SIMD array processor in accordance with the present invention is particularly 
suitable for image processing applications. 

Figure 2 illustrates how the array controller shown in Figure 1 is structured in the specific embodiment 
of a SIMD array processor in accordance with the present invention. Neither the detailed structure of the 
array controller shown in Figure 2, nor specific details of its operation are essential to the present invention. 
Consequently, the structure and operation of the controller will only be briefly described in the following. 

The array controller 14 comprises a microcode store 32 into which microcode defining the processing 
to be performed by the array processor is loaded by the host 28 using the data bus 30 and the address and 
control bus 31. Once the operation of the array controller 14 has been initiated by the host 28, the 
sequencing of the microcode is controlled by the microcode control unit 34 which is connected to the 
microcode store by bus 36. An ALU 38 and register bank 40 are used in the generation of array memory 
addresses which are output on the address bus 24, loop counting, jump address calculation and miscella- 
neous general purpose register operations. A flag line 39 is provided for conditional branching. A row mask 
PLA (Programmed Logic Array) 42 and a column mask PLA 44 are used for decoding row and column 
mask codes in a microinstruction being executed to generate signals on Individual row select lines 20 and 
column select lines 22. Operation codes forming the instructions to the processing elements P(l,j) are fed 
onto the instruction bus 18. A data butter 46 Is shown between the host-controller data bus 30 and the 
controller-array data, bus 26. This allows data from the host which is to be written into the array of 
processors to be rapidly down-loaded into the array controller 14. The data can then be loaded, under 
control of the microcode, into the array of processors. Similarly, the buffer can be used for transferring data 
between the array and the host For this purpose the buffer is arranged as a bidirectional FIFO buffer under 
control of the microcode control unit. 

The instruction format used in the specific embodiment of the present invention is illustrated in Figure 
3. it should be noted that the format shown in Figure 3 is merely that used in the specific example of a 
SIMD array processor described herein. In other embodiments of the invention another format might well be 
used depending on the form of the controller for the processor array, the complexity of the individual 
processing elements and so on as will be apparent from the following description to one skilled in the art. 

The fields of the instruction which relate to the control of the processor array are the processing 
element operation code "PeOP", bits 63 to 56, the row mask code "Maskr", bits 55 to 48, and the column 
mask code "Maskc", bits 47 to 40. The "PeOP" field forms the operation code, or instruction, which is 
Issued globally in parallel to processing elements in the array. The purpose of the row and column masks is 
to enable the instruction specified by the "PeOP" code to be executed by selected processing elements 
only. This enables memory read operations, Inter-processor element shifts and intra-processor element 
register operations to be performed by selected processing elements only. The contents of the "Maskr" and 
"Maskc" fields are decoded by the row mask PLA 42 and the column mask PLA 44, respectively, for 
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conventional manner as will be evident to one skilled in the art 

In prior art SIMD array processors the decoder has been hard-wired, usually in the form of a plurality of 
hard-wired logic gates. The decoder in a SIMD array processor in accordance with the present invention is. 
in contrast programmable. In a particular embodiment of the invention, the decoder is programmable by the 
provision of a look-up table which operates as an instruction modifier. Further, in this embodiment of the 
invention, only selected bits of the operation code Input to the decoder 64 are modified by the look-up 
table. 

Figure 5 illustrates the decoder 64 of this specific embodiment of the present invention in more detail. It 
comprises a first part 72 in the form of conventional fixed decoder logic such as hard-wired gates and a 
second, programmable part in the form of a look-up table (LUT) 74. The bits of the operation code on lines 
18(1) to 18(vi) and the row and column select lines are input directly to the PLA as usual, but two of the bits 
18(v) and 18(vi) of the operation code are also used to address the look-up table In parallel. The two-bit 
output of the look-up table location accessed by these bits forms modified operation bit lines 18(vil) and 18- 
(vili) which are also Input to the fixed decoder logic 72. The fixed decoder logic 72 logically combines the 
Input data on lines 1 8(i)-(viii) to form the output control information on the control buses 66, 68 and 70. 

The look-up table shown In Figure 5 comprises four words of two bits each. These eight bits of data are 
loaded in series over a data line 76 from memory 16(l,j) (see also Figure 4) in response to global "load 
look-up table" instruction from the array controller. As the look-up tables of the processing elements will 
contain indeterminate information before being initialised, the "load look-up table" instruction only uses 
unmodified bits 18(i) to (vi) of the operation code as received , that is the bits that do not go through the 
look-up table. The decoder in each of the processing elements produces the' control signals on the buses 
66, 68, 70 and on the control line 78 internal to the decoder when this Instruction is received Irrespective of 
the value of the lines 18(v) and 18(vi). The control line 78 is a write enable line for the look-up table. 
Appropriate control, or modification, data for the look-up table of each of the respective processing 
elements would have been previously loaded via the data bus 26 and the Q register 54 into corresponding 
locations in the slice of memory 16(1,)) associated with each processing element P(i,j) so that the control 
data may be accessed and read into the look-up tables of each of the processing elements using global 
instructions and memory addresses. The storing of the control information is carried out by operating the 
array in a prior art manner using global unmodified instructions. 

In a SIMD array processor according to the present invention there are essentially two sorts of global 
instructions defined by the "PeOP" operation codes. These are global instructions which cannot be 
modified locally and global instructions which can be modified locally. The first sort are global instructions 
which are used for initially loading data into the processor array, for shifting the data through the array for 
storing that data in the array memory and for subsequently loading modification data into the look-up tables. 
All other instructions can, in principle be modified locally, but they can only be used when appropriate 
modification information has been loaded into the look-up tables. The fixed decoder logic 72 logically 
combines the input data on lines 18{i) to 18(vi) (ie the unmodified instruction bits) in such a manner that it 
recognises whether the instruction being decoded is locally modifiable and whether the input data on lines 
18{vii) and I8(viii) (ie the modified instruction bits) are to be used to determine the operation actually 
performed by the processing element. 

In the present example of a SIMD array processor in accordance with the present invention, the 
programmable decoder is used to specify a different shift direction for different processing elements 
despite the restriction of the global instructions. The actual direction in which data is shifted is the result of 
the selection of one of the NEWS inputs to the input multiplexer 62. Given that two bits of the instruction 
code (eg. the bits 18(v) and 18(vi)) are used to specify the global direction of shift in the NEWS network, a 
look-up table for local modification of those two bits means that it is possible to individually specify a local 
direction of shift in each processing element in response to a given global shift instruction. 

The preparation of the SIMD array processor shown for performing an algorithm which exploits the local 
modification of shift instructions can be summarised as follows. 

Successive 32-bit words of data are read into the Western edge of the array of processors via the 
bidirectional tri-state drivers in the toroidal East-West NEWS connections and are shifted across the array 
using global unmodified shift East instructions. When the first word of data has migrated across the array of 
processors, respective bits of the first 32 words of data are written into corresponding memory locations in 
the blocks of memory associated with each processing element using a global unmodified write instruction. 
These steps are repeated until all the necessary information has been loaded into memory. During or after 
the above sequence, modification data is read into the look-up tables of the processing elements using a 
global unmodified "load look-up table" instruction. Once this step has been performed, the array of 
processors can be used to perform algorithms using locally modifiable instructions. 
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For ease of illustration the algorithm is shown for an 8 by 8 processor array in Figures 7a and 7b. It can 
easily be developed for a 32 by 32 processor array. The algorithm runs in two steps. The first runs for 4 
cycles and has the NEWS setting shown in Figure 7a. The second step runs in one cycle and is simply a 
global shift west This has the NEWS setting shown in Figure 7b. The algorithm takes 1 +n/2 cycles to 
implement X-axis reflect on an n by n array (n even). 

For the algorithm shown it is only necessary to set the look-up tables once at the beginning of the 
reflection operation. Four first global shift instructions are issued which are locally modified to give the 
pattern shown in Figure 7a which cause any bit to be moved four steps along the path in which it is located. 
Then a single second global shift instruction (a global shift West) Is issued which does not need to be 
locally modified and gives the NEWS pattern shown in Figure 7b. This causes any bit to be moved one 
step Westwards. It can be seen that each bit ends up in a position which forms the reflection in the X axis 
with respect to its original position. The change In the shift directions of Figure 7b with respect to Figure 7a 
is caused merely by. the use of two different global shift Instructions. In the case of Figure 7a the global 
instruction Is modified by modifier bits which vary from processor element to processor element. In the 
case of Figure 7b, the global instruction is not modified. 

Figure 8 illustrates modifications to a processor element which further enhance the flexibility of a SIMO 
array processor in accordance with the present invention. 

In a typical operating cycle in a SIMD array processor a processing element in the array selects data 
from a single neighbour in the NEWS network. This does not, however, make optimal use of the network 
connections because only one of the input connections to each cell is used in any one shift cycle, it would 
appear that 75% of the NEWS connections are idle. In practice however, the NEWS connections are 
bidirectional, and as one of the "Input "connections for a given processing element is In fact used for the 
output from that element, only 50% of the network Is in fact Idle. Nevertheless, even this 50% represents an 
underutllisation of the network. The principle modification to the processing elements shown In Figure 8 Is 
to provide two NEWS output registers Qns 54ns and Qew 54ew. The provision of these two registers 
provides the basis for allowing shift operations in two directions per cycle e.g. one Item North, and one item 
East. This represents more efficient use of the NEWS wiring. In addition to the above modifications, some 
additional modifications of the processing elements are necessary. 

As shown in Figure 8, the input multiplexer 62 is a multi-way multiplexer which separately selects two 
of the NEWS inputs to the processing element P'(i,j) at one time and supplies them to respective inputs 
Nns and New to the ALU 48. In addition, a multiplexer function is provided within the ALU 48 to select 
between the outputs of the Qns and the Qew registers. The Qns register outputs data to the North and 
South neighbours, and the Qew register passes data to the East and West neighbours. Each of the Q 
registers may sample data from any of the four NEWS Inputs via the input multiplexer 62 and the ALU 48 . 
A typical cycle might consist of Qns taking data from the West, and Qew taking data from the South. Two 
such cycles would cause the two sets of data held in the Qns and Qew registers each to move diagonally 
North-East one position. With only one output register Q, four cycles would be required to achieve these 
shifts. In this way it is possible for a processing element to shift two bits of data simultaneously. 

Further details of the modifications to these components or of the changes to the control lines 66 , 
68,70' and to the logic in the decoder 64' need not be given here as they are merely a matter of routine to 
implement. Also, as will be apparent to the one skilled in the art, other modifications of the processing 
element are possible which will support the duplication of the Q register. 

Although the resulting processing element of Figure 8 is more complex than that shown In Figure 4, it 
does increase further the flexibility and efficiency of the NEWS network. This is achieved, moreover, without 
additional NEWS connections for each processing element if the input and output lines to processing 
elements are bidirectional, as the input and output NEWS connections of the processing elements are 
shared. Also, it is possible for a processing element as shown in Figure 8 to process two bits of data 
simultaneously. 

In the following, three algorithms which exploit the modifications in Figure 8 are described with 
reference to Figures 9, 10 and 11. For ease of illustration, the algorithms are shown for an 8 by 8 array 
only, with each processing element p'fJJ) represented, as before, by a small circle. When interpreting the 
Figures, it should be remembered that the array is toroidally connected. 

The first of these algorithms illustrated in Figure 9. This figure represents a North-West shift over the 
whole array. In Figure 9 the arrow labelled 86 at the processing element 82 represents the use of the Qns 
output register 54ns In Figure 8 for receiving data via the input multiplexer 62 from the Eastern NEWS 
connection to that processing element. Similarly, the arrow labelled 84 at that processing element in Figure 
9a represents the use of the Qew output register 54ew in Figure 8 for receiving data from the Southern 
NEWS connection via the input multiplexer 62' to that processing element. Thus two transfers are being 
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Claims 

1. A SIMD array processor comprising a multi-dimensional array (12) of processing elements (P) and 
control logic for issuing global instructions to said array, characterised in that a processing element (P i,j) 
includes programmable decoding means (64) for the individual decoding for execution by that processing 
element of a global instruction, the programmable decoding means of respective processing elements being 
programmable in response to a global load instruction from the control logic. 

2. A SIMD array processor as claimed in claim 1 wherein the programmable decoding means 
comprises programmable modifying means (74) for locally modifying selected bits of the global instruction 
to form locally modified bits and fixed decoding means (72) for decoding bits of the global instruction as 
received and said locally modified bits. 

3. A SIMD array processor as claimed in claim 2 wherein processing elements in the array are each 
associated with storage (16) for control information and/or and data and wherein, in response to said global 
load instruction, the fixed decoding means (72) In a processing element causes modification information to 
be loaded from selected locations in said storage into the programmable modifying means (74) of that 
processing element, whereby the programmable modifying means of respective processing elements may 
be programmed. »-. 

4. A SIMD array processor as claimed in claim 3 wherein processing elements (P) in the array are eacn 
associated with a corresponding block of said storage (16) for control information and/or and data and 
wherein means are provided for the control logic (14) to access said storage (16) for storing appropriate 
modification Information for the programmable decoding means (74) In corresponding locations in each said 
block of storage. 

5. A SIMD array processor as claimed In claim 2 or in any claim dependent thereon, wherein the 
programmable modifying means (74) comprises a look-up table. , 

6. A SIMD array processor as claimed In claim 5 wherein the look-up table (74) comprises a serial wnte 
port (76) for receiving said modification information serially from storage and a parallel read port for 
receiving said selected bits (18(v). 18(vi)) of a global instruction in parallel. 

7. A SIMD array processor as claimed in any of the preceding claims in which the programmable 
decoding means (74) is adapted to be programmed to locally modify a global shift instruction, whereby data 
distributed throughout the array (12) may be shifted at one time in a plurality of locally determined 
directions within the array. 

8. A SIMO array processor as claimed in any of the preceding claims wherein the processing elements 
(P) are interconnected in a plurality of orthogonal directions. 

9. A SIMO array processor as claimed in claim 8 wherein each processing element comprises a 
plurality of output registers (54) and an input multiplexer (62') such that multiple simultaneous data shift 
operations can be performed in a plurality of orthogonal directions at one time within a processing element 

10. A display system comprising a SIMD array processor as claimed in any of the preceding claims. 
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